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1 Introduction and results 



1.1 Background and Motivation 

Usually, a limit theorem of Probability Theory is a theorem that concerns conver- 
gence of a sequence of distributions Pn to a distribution P. However, there is a 
number of works where the traditional setup is modified, and the object of study 
is two sequences of distributions, {P^} and {Qn}- The goal in this case consists in 
establishing conditions for convergence 

Pn-Qn^Q (1.1.1) 

in a proper sense. In particular problems, Pn and Qn are, as a rule, the distributions 
of the r. v.'s /„ (Xi , . . . , X„) and /„ (Yi , . . . , y„) , where /„ ( • ) is a function, and Xi , X2, . . . 
and , 72, ••• are two sequences of r.v.'s. The aim here is rather to show that differ- 
ent random arguments Xi , . . . , X„ may generate close distributions of fn {X\ , . . . , Z„) , 
than to prove that the distribution of ...,X„) is close to some fixed distribu- 

tion (which, above else, may be not true). 

Consider, for example, a quadratic form < A,iX„,X„ >, where A„ is a n x n- 
matrix and X„ = {X\, ...,X„) is a vector with i.i.d. coordinates. In this case, the 
limiting distribution, if any, depends on the matrices A„. For instance, with a 
proper normalization, the form X\X2 -I-X2X3 -|- ... -\-Xn-\Xn is asymptotically nor- 
mal (if E{Xf} < 00), while the form {X[ + ... -fX„)^ has the limiting distribu- 
tion. Nevertheless, one can state the following unified limit theorem. 

Denote by P„f the distribution of < A„X„,X,i > in the case when each X, has 
a distribution F. Then, under rather mild conditions, 

PnF-PnG^O (1.1.2) 

for any two distributions F and G with the same first two moments (see, | fT3l . 
[tZJ for detail, and references therein). A class if such that (11.1.21) is true for any 
F, G e is called an invariance class ([fT3|). 

Let us come back to (|l.l.ll) . Clearly, such a framework is more general than 
the traditional one. First, as was mentioned, the distributions Pn and Qn them- 
selves do not have to converge. Secondly, the sequences {Pn} and {Qn} are not 
assumed to be tight, and the convergence in (|l.l.ll) covers situations when a part 
of the probability distributions or the whole distributions "move away to infinity" 
while the distributions Pn and Qn are approaching each other. 

To our knowledge, the scheme above was first systematically used in Loeve 
[fTOl Chapter VIII, Section 28, The Central Asymptotic Problem], who considered 
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sums of dependent r.v.'s. The same approach is applied in some non-classical 
limit theorems for sums of r.v.'s; that is, theorems not involving the condition of 
asymptotic negligibility of separate terms (see, e.g., monograph [19] by Zolotarev, 
survey [13J by Rotar, and references in [19] and fT3\; Liptser and Shiryaev 
and Davydov and Rotar [l6l on a non-classical invariance principle.) 

Non-linear functions /„ have been also considered in the above framework. In 
particular, it concerns polynomials, polylinear forms of r.v.'s, and quasi-polynomial 
functions; see, e.g., Rotar [13J and [14J for limit theorems, Gotze and Tikhomirov 
[(7l, and Mossel, O'Donnel and Oleszkiewicz [llj for the accuracy of the cor- 
responding invariance principle. Other interesting schemes different from those 
above were explored in D'Aristotile, Diaconis, and Freedman [2 J and in Chatter- 



The present paper addresses general facts on convergence (II. 1.11) . A corre- 
sponding theory was built in Dudley Chapter 11] and D'Aristotile, 
Diaconis, and Freedman The paper [2J concerns some possible definitions 
of convergence (II. 1.11 ) in terms of uniformities, and establishes connections be- 
tween these definitions (see also below). The theory in [13|-[[5l (which is used in 
part in [2J also) is mainly based on a metric approach. We complement and, to 
a certain extent, develop the theory from [2J and [5J, paying more attention to a 
functional approach. Throughout this paper, we repeatedly refer to and cite results 
from 

First, consider three definitions of convergence (II. 1.11 ) explored in [O (or, in 
the terminology of [121, "merging"). 

Dl. n{Pn, Qn) where tt is the Levy-Prokhorov metric. 



for all bounded continuous functions /. 

D3. T{Pn) — T{Qn) for all bounded and continuous (with respect to weak * 
topology) functions T on the space of probability measures. 

In f2\, it was shown that D3 ^ D2 ^ Dl, and D1,D2,D3 are equivalent iff 
the space on which measures are defined, is compact. As one can derive from 
and as follows from results below, once we consider particular sequences {P„} 
and {Qn}, the above definitions are equivalent if one of the sequences is tight. 



jeeUl. 



D2. 




(1.1.3) 
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In the general setup, when the above sequences {P„} and {Qn} are not as- 
sumed to be tight, Definition D2 (and hence D3 also) looks too strong. As an 
example, consider that from [2]. Let us deal with distributions on the real line, 
and let be concentrated at the point n, and Qn - at the point n-\-^. Clearly, 
(11.1.31) is not true for, say, f{x) = sin(x^). On the other hand, it would have been 
unnatural, if a definition had not covered such a trivial case of asymptotic prox- 
imity of distributions. (Clearly, in this case, 7r(/'„, Qn) — > 0. To make the example 
simpler, one may consider f{x) = sin {^x^)- Certainly, the example above con- 
cerns the Euclidean metric in M. For other metrics, points n and « + ^ may be not 
close. Below, we cover the general case of a complete separable metric space.) 

To fix the situation, one can consider (11.1.31) for functions only from the class 
of all bounded continuous functions vanishing at infinity, but such an approach 
would be too restrictive. In this case, the definition would not cover situations 
where parts of the distributions move away to infinity, continuing to approach 
each other (or, in the terminology from [2J, "merge"). On the other hand, in 
accordance with the same definition, the distributions P„ and Qn concentrated, for 
example, at points n and 2n, would be viewed as merging, which also does not 
look reasonable. 

In this paper, we suggest to define weak convergence as that with respect to all 
bounded uniformly continuous functions. (This type of convergence was not con- 
sidered in [2J and We justify this definition proving that such a convergence 
is equivalent to convergence in the Levy-Prokhorov metric that satisfies some nat- 
ural, in our opinion, requirements. In the counterpart of Definition D3, we require 
the uniform continuity of T. 

We establish also some facts concerning weak convergence uniform on certain 
classes of functions / (or linear functional on the space of distributions); see 
Section 11.2.31 for detail. Proofs turn out to be, though not very difficult, but not 
absolutely trivial since the absence of tightness requires additional constructions. 
The point is that in the generalized setup, we cannot choose just one compact, not 
depending on n, on which all measures will be "almost concentrated". 

On the other hand, as will follow from results below, if one of the sequences, 
Pn or Qn, is tight, the definition of weak convergence suggested is equivalent to 
the classical definition, and we deal with the classical framework. 

We would like to thank P.J.Fitzsimmons and F.D.Lesley for useful discussions. 
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1.2 Main Results 



1.2.1 Weak convergence and the Levy-Prokhorov metric 

Let (H, p) be a complete separable metric space, and "B be the corresponding 
Borel a-algebra. 

The symbols P and Q, with or without indices, will denote probability distri- 
butions on 'B. All functions / below, perhaps with indices, are continuous func- 
tions / : H ^ M. 

We denote by C the class of all bounded and continuous functions on (H, p), 
and by C - the class of all bounded and uniformly continuous functions. 

For two sequences of probability measures (distributions), {P,,} and we 
say that Pn — Qn ^ weakly with respect to (w.r.t.) a class of functions Ki if 
Jfd{Pn-Qn)^Qfor^\\fe-K. 

If we do not mention a particular class the term weak convergence (or 
more precisely, merging) will concern that w.r.t. C . When it cannot cause mis- 
understanding, we will use the term "convergence" in the situation of merging 
also. 

In the space of probability distributions on !S , we define - in a usual way - the 
Levy-Prokhorov metric 

7l(P,(2) =inf{£:i'(A^) < 2(A)+£ for all closed sets A}. (1.2.1) 

(One can restrict himself to only one inequality, not switching P and Q\ see Dudley 
[11 Theorem 11.3.1].) 
Our main result is 

Theorem 1 The difference 

Pn-Qn^O weakly (w.r.t. 'c) (1-2.2) 

if and only if 

n{PnMn)^0. (1.2.3) 

The choice of the Levy-Prokhorov metric as a "good" metric that justifies 
the definition of weak convergence above, is connected, first of all, with the fact 
that the analog of the Skorokhod representation theorem ([16], see also, e.g., fSl 
Sec. 11.7]) holds in the case of merging measures. More precisely, the following 
is true. 
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Let, the symbols X and Y, perhaps with indices, denote random variables de- 
fined on a probability space {Q.,Jl,P), and assuming values in EI (that is, these 
variables are Si ^ 'B measurable.) The symbol Px stands for the distribution of X. 

Below, two metrics r\{x,y) and r2{x,y) in a space are said to be uniformly 
equivalent, if for any two sequences {xn} and {yn}, the relations ri{xn,yn) — * 
and r2{xn-,yn) ^ are equivalent. 

The first two (and main) assertions of the next theorem are stated and proved in 
Dudley [4J ; see also the second edition [5 , Theorem 11.7.1]. For the completeness 
of the picture, we present all facts regarding the metric n in one theorem. 

Theorem 2 Metric % is the only metric, to within uniform equivalence, that satis- 
fies the following conditions. 

A. //p(X„,y„) ^ 0, then n{Px„, Py„) ^ 0. 

B. Ifn^Pn, Qn) — * 0, then there exist a probability space and random elements 

P 

Xn, Yn on this space such that Px„ = Pn, Qn = Py,,, and p(X„, Yn) — > 0. 

C. Ifn{Pm Qn) 0, then Tl{Pn° f^^ ,Qn° f^^) for any uniformly contin- 
uous function f. 

D. If Qn = Q, then the convergence 7r(/'„, Q) ^ is equivalent to weak con- 
vergence with respect to all bounded continuous functions. 



Remarks. 

1. We have already mentioned above an example showing that convergence 
(11.1.31) for all / G C does not possess Property A. In other words, there exist 

r.v.'s Xn and F„ such that p{X„,Yn) 0, while Px„ — Py„ ^0 weakly with 
respect to C If HI has bounded but non-compact sets, a similar example may 
be constructed even for continuous functions equal to zero out of a closed 
bounded set. 

Indeed, let Or{x) = {y : p{x,y) < r}. Consider the case where for some xq, 
the ball O ~ Oi (xq) is not compact. Then there exists a sequence {x„} C O 
which does not contain a converging subsequence. Furthermore, there exists 
a numerical sequence 5„ 0, such that the balls 0^^{x„) are disjoint, and 
each contains only one element from that is, the center Xn- We define 

•^^^ 10 if X j^Uk08,{xk). 
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The function / is, first, bounded, and secondly, due to the choice of {x,,}, / 
is continuous. On the other hand, one may set X„ = jc„ and y„ = where 
yn is a point from the boundary of 0§,,(x„). Clearly, p(X„,y„) = 6„ ^ 0, 
while / fdPx„ = 1 and / fdPy,, = 0. 

2. As was mentioned in the introduction, if one of the sequences, say {Qn}, 
is tight, and (11.2.21) is true, then the other sequence, {Pn}, is also tight. 
In this case, relation (11.1.31 ) is true for all / G C, and we deal with the 
classical scheme. If (H, p) is a space in which any closed bounded set is 
compact, this fact is easy to prove directly. In the general case, it is easier 
to appeal to Theorem [T] and Prokhorov's theorem on relative compactness 
w.r.t. functions from C ( fil2il '). 

More precisely, assume that (|1.2.2I) holds and {2;,} is tight. Then, by Pro- 
khorov's theorem, {Qn} is relatively compact with respect to weak con- 
vergence for functions from C. Let a subsequence weakly converges 
to some Q w.r.t. C, and hence 0. By virtue of Theorem [H 

7l(i'„^, Qn^) 0, and consequently, n{P„j^,Q) 0. So, P,,^ converges to the 
same Q w.r.t. to C, and 



Thus, any subsequence of {P„} contains a subsubsequence convergent w.r.t. 
C. Hence, again by Prokhorov's theorem, is tight. 

Moreover, in this case Pn — Qn ^ w.r.t. C. Indeed, otherwise we could 
select convergent subsequences and and a bounded and continuous 
/ such that / fd{P,^ — Qn,^) 0, which would have contradicted (11.2.41 ). 

3. Let us return to Definition D3 from Section 11.11 To make it suitable to 
the setup of this paper, one should consider functions T on the space of 
probability measures on 'B, uniformly continuous with respect to the the 
Levy-Prokhorov metric (or, which is the same, w.r.t. the weak convergence 
regarding C). So modified Definition D3 will be equivalent to convergences 
(fT:2a - (fL23]) . 

1.2.2 Lipschitz functions 

For / G C, we set 




w.r.t. to all functions from C . 



(1.2.4) 
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andC5L = {/:ll/|lz,<-, ll/L < 

In Dudley [5, Sec. 1 1.3], it was shown that in the traditional setup, for the weak 

convergence Pn P w.r.t. the whole class C, it suffices to have the convergence 
w.r.t. Cbl- a similar property is true for the generalized setup of merging proba- 
bility measures. Namely, let {Pn} and be two fixed sequences of probability 
measures. 



Theorem 3 The weak convergence Pn — Qn ^ with respect to Cbl implies the 
weak convergence with respect to C. 

Next, we consider classes of functions on which weak convergence is uniform. 



1.2.3 Uniform convergence 



In Dudley it was shown that in the traditional setup, weak convergence is 
uniform on any class of functions / with uniformly bounded norms 
^. More precisely, consider the metric 



and 



P(P,Q):=sup 



f fd{P-Q) 



L + 



< 1 



In [[51 Section 1.3], it was proved that the weak convergence P„ — > P w. r. t. C, is 
equivalent to the convergence 0. 

We establish a similar property in the generalized setup and for arbitrary classes 
of functions with a fixed order of their moduli of continuity. 

For / G we define its modulus of continuity 



«/W = sup{|/(x) -/(j)! : p{x,y) < h}. 



(1.2.5) 



Let (i>{h) be a fixed non-decreasing function on IR+, such that (o(/z) ^ as 
h^O. Set 



Cco = {/:ll/L<-, and (af{h)=0{oi{h)+h)}. 

(Usually, h = 0{Qd{h)), and one can write just QOf(h) = 0{(D{h)). However, there 
are situations when (o(/z) even equals zero for sufficiently small /I's; for example, 
if EI = N with the usual metric.) 

The next proposition, having its intrinsic value, plays an essential role in prov- 
ing Theorem m 
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Theorem 4 Let 




(1.2.6) 



for all f G Ceo, and let 



i^'co = {/ : ll/L < 1, and (Df{h)<(£){h) for all h>0}. 



Then 



sup 




(1.2.7) 



Clearly, instead of the above class ^a, one may consider a class of uniformly 
bounded (not necessarily by one) functions / such that (xif{h) < ki(x){h) -\-k2h, 
where ^1,^2 are fixed constants. (Such a formal generalization follows from 
(11.2.71 ) just by replacing (o(/j) by ki&{h) -\-k2h.) 

Corollary 5 If M.lM is true for all f G Cbl, then 



for any class J of uniformly bounded functions with uniformly bounded Lipschitz 
constants. 

Corollary 6 If U.2M is true for all f E C, then {\1.2.8\) is true for any class J of 
uniformly bounded and uniformly equicontinuous functions. 

To derive the above corollaries from Theorem HI one should set (£>{h) = 
(D-f (h) := supjr^yr (£>f{h). (In the literature, there is no unity in definitions of 
equicontinuity: some authors define it pointwise; in other definitions, the word 
"uniformly" is redundant. When talking about uniform equicontinuity, we mean 
that the function (Oj {h) is bounded and vanishing at the origin.) 



Proofs of Theorems[T]and[3]essentially use Corollary [5] from Theorem|4]and The- 
orem m We start with a proof of the latter theorem - the main assertions of this 
theorem, A and B, are known (|I51 Sec. 11.7]), and the rest of the proof is short. 
The proof of Theorem|4]is relegated to the last Section [2^ 




(1.2.8) 



2 Proofs 
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2.1 Proofs of Theorems d-ll] 
2.1.1 Proof of Theorem H 

To justify Property C, consider the r.v.'s X„,Y„ defined in Property B. We have 

\f{Xn)-fiY„)\<(Of{p{X,M). Consequently, /(X„) -/(y„) ^0, and it suffices 
to appeal to Property A. 

Property D is obvious. Now, let ri(-, ■) and /"2(-, ■) be two metrics with Prop- 
erties A-B. If ri (Pn, Qn) ^0, then there exist X„, ¥„ for which p y„) 0, and 
hence by Property A, r2{Pn-,Qn) ^ 0. ■ 

For proving Theorems [T] and |3l we need 



2.1.2 Two lemmas 

Lemma 7 IfTi{Pn,Qn) 0, then 



sup / fd{Pn-Qn)^0 



(2.1.1) 



for any class J of uniformly bounded and uniformly equicontinuous functions. 

Proof. By Theorem [21 there exist Xn,Yn such that Px„ = Pn, Qn = Py„, and 

p(X„,y„)^0. By conditions of the lemma, M:=supyg^ ||/||^ < oo, and (0(/z) : = 
supyg^ (iif{h) ^ as /z ^ 0. For any £ > 0, 



/ 



fd{Pn-Qn) 



= \E {f{Xn) - /(F„) } \<E{ |/(X„) - /(F„) I } 

= £{|/(x„)-/(y„)|;p(x„,y„)>£} 

+ £{|/(x„)-/(y„)|;p(x„,y,o<£} 

< 2M/'(p(X„,y„) >£)+(0(£). 



Hence, 



lim sup 



fd{Pn-Qn] 



< (o(£) ^ as £ ^ 0. 



Lemma 8 (Dudley [5^ a part of Theorem 11.7.1]). Suppose A2.1.1\i is true for 
^ = ^1 := {/ : ll/L < 1, II/IIl < !}• Then n{Pn, Qn) 0. 
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Proof. In [|5]|, the proof of this fact is based on the relation n < 2a/P, which 
is proved separately. For the completeness of the picture, we give a direct proof 
(which, in essence, is very close to the reasoning in [5^ p. 396 ]). 

For a closed set K, and an e > 0, set 

r 1 ifjcG^, 

4W = < ^--ePM if xeK^\K, 

[ otherwise. 

(Here, is the £-neighborhood of K.) 

Since oO/e (/?) < ^h, the family {/|-(jc) : K is closed} C := {/ : ll/L < 
1, II/IIl < l/e}- Clearly, if (12X11) holds for y = 5i, then it holds for = iTe for 
any £ > 0. Therefore, 



sup 

K 



ll{x)d{Pn-Qn) 







(2.1.2) 



for any £ > as n — oo 
On the other hand. 



Pn{K) < I ll{x)dPn < A„(£) +2„(iS:^). (2.1.3) 

From (12.1.21 ) and (12.1.31 ). it follows that for sufficiently large n, 

which implies that Ti{Pn,Qn) < £• Since £ is arbitrary small, this means that 



2.1.3 Proof of Theorem I] 

The implication n{Pn:Qn) ^ f fd{Pn — 2n) — > for any f E C, immediately 
follows from Lemma |71 

Assume / fd{P„ — Qn) for any f E C Then, the same is true for all 
/ e Cbl- 

Hence, by Corollary [5] from Theorem |4l relation (12.1.11 ) holds for J = Ji 
(defined in Lemma[8]). This implies the convergence Ti{Pn,Qn) — ^ by virtue of 
Lemma [8l ■ 
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2.1.4 Proof of Theorem |3] 

Let ffd{Pn - Qn) for an y f E Cbl- 

As was proved in Section [2. 1 .31 above. 7r(i'„, Qn) 0. By virtue of Theorem 
[B this implies that ffd{P„-Q„)^0 for all f e'c. M 

2.2 Proof of Theorem H 

2.2.1 Three more lemmas 

Lemma 9 For any two functions f and g, 



provided that the l.-h.sides are finite. 

Proof is straightforward and very close to that in ^ Propositions 11.2.1-2] 
dealing with Lipschitz functions. 

Next, for a function f{x), a set K, and a number ? > 0, we define the function 



CO/g(/z) 
(i)fyg{h) 

&fAg{h) 



< max{coy(/z), a)g(/z)}, 

< max{(i)f{h),(Og{h)}. 




(2.2.1) 
(2.2.2) 
(2.2.3) 




(2.2.4) 



Lemma 10 Let f be a bounded uniformly continuous function. Then 



■(0 



< 11/11 



(2.2.5) 



and for any h>0, 



(0 (o(/i)<a)/(/i) + ||/L-. 

Jk t 



(2.2.6) 



Proof. Bound (|2.2.5I) is obvious. Next, note that for any x and y. 



p{x,K)-p{y,K)\<p{x,y). 



(2.2.7) 



(Indeed, for any zE K, 



p{x,K) < p(x,z) < p{x,y) + p{y,z), 
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which implies that p{x,K) < p{x,y) +p{y,K). We can also switch x andj.) 
Thus, for qt{x) := I — p{x,K)/t, we have 

<^q,{h) < h/t. 

Together with (|2.2.1I) . this implies (I2.2.6I) . ■ 

Note that, in particular, from Lemma [TOl it follows that if / is uniformly con- 
tinuous, so does 

Let the signed measure ^„ = Pn — Qn. 



Lemma 11 Suppose 



(2.2.8) 



for any f & C. Let f be a class of uniformly bounded and uniformly equicontin- 
uous functions. Set 

(xi{h) := sup (Df{h). (2.2.9) 
Then for any compact K, and t > 0, 



lim sup 



f^ d^n 



< 4(0(0 



(2.2.10) 



Proof. By the Arzela-Ascoli theorem, for any £ > 0, there is a finite family 
{f\-,----,fd} C J such that for any f E !F , there exists s = s{f) E {l,...,d}, for 
which 

sup|/(x)-/,(^)|<£. (2.2.11) 



xeK 



On the other hand, for any zE K, and x E K', 



p{x,K) 



< 1/ W - fiz) I + \fs{x) - /.(z) I + - /.(z) I 

< 2a)(p(x,z))+£. 



Hence, for E K', 



l/^^W -/iiWI< 2(0(0 +£• 



(2.2.12) 
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Therefore, 



< 



{ff{^)-fl'K{^))d^n 



0, 



+ 



it) 



< 2(2(0(0 +e) + 



< 4(o(?)+2£+ max 

me{l,...,d} 



Since 



max 

me{l,...,d} 



and £ is arbitrary small, this implies (|2.2.10l) . 
We turn to 



as n — > oo 



(2.2.13) 



2.2.2 A direct proof of Theorem H 

Consider a fixed function (o(/z) , and the class 5 = ^Fq) from the statement of Theo- 
remlH Assume that there exist a sequence {/i,/2, ... } C , a sequence {m^}, and 
a 5 > 0, such that |/ f^d^'mt. | > 5 for all = 1, 2, ... . Without loss of generality 
we can identify {nik} with N, and write just 



/ 



fkd'i'k 



>5 foralU= 1,2, 



We may also assume that for all k's, 

0<fk{x)<l. 



(2.2.14) 



Now, let t and £ < ? be two fixed positive numbers to be chosen later. Let 
Hi = 1, and ^1 be a compact such that 

l^nil(^l)<^- 

(Here the measure |^| (dx) is the variation of ^'{dx), and is the complement of 
K.) 

Let ^2 > ^1 + 1 be a number such that for all n> n2 



(2.2.15) 
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and 



sup 

j 



jfJk 



< 5&{t). 



(2.2.16) 



Inequality (12.2.151 ) is true for sufficiently large n because f^^j^^ is uniformly con- 
tinuous due to Lemma [lOl and (12.2.161 ) holds for large n by virtue of (12.2.101) . 
Note also that in (|2.2.16l) we deal with the supremum over a class of functions, 
while (|2.2.15l) concerns only one fixed function. 

Next, we consider a compact K2 such that K2D Ki, and 



Let us set /i = /i , and 



I^n2l(^2)<^- 



By virtue of (12.2. 16L 

Also, 



f2 — fn2 fn2,Ki' 

11/2 ||oo < 1, and /2(x) =0 foralljcGi^i. 



"2 



By Lemma [TOl 



00/2 W < (0/„,(/?) +(0,w {h) < 2(o(/z) + 



h 



Now, we set Li = ^1 , and L2 = ^2 \ • Let 

^iW=/SfW' and g2{x)=g,{x)+fif^\x). 
By construction, 

^1 (x) =0 for X ^ K^^^, and ^2 (x) =0 for .x: ^ 2^2^'^ • 
By Lemma [TOl 

iOg, (h) < io{h) + ^ = io{h) +—. 



(2.2.17) 



(2.2.18) 



(2.2.19) 
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Now, since the sets L^'^^ and ^ are disjoint, in (I2.2.18I) . either {x) or f2L2' 6<iuals 

zero. So, we can also write that g2{x) = max{gi(x), /2L2^''W}- Then, from 
LemmalU Lemma [TOl (I2.2.19D . and (12.2. 171) . it follows that 

h h 3h 
(Og (h) < max{(Ogj(jc), (Or (h) + —} < 2(o{h) -\ \ . (2.2.20) 

^ ■' £/3 t £ 



re/3 



In view of (12.2.191) . bound (12.2.201) is true for both functions, gi and ^2- 

Thus, both functions, gi and are bounded and uniformly continuous (since 
> are fixed). 

Next, we choose ^3 > ^2 + 1 such that for all n > ^3, 



g2{x)cm'n 



and 



sup 

j 



<5(o(0. 



Let ^3 be a compact such that ^3 D ^2, and 



I^n3l(^5)<^ 

We define a function 

which has properties similar to those of /2, and we define the set 

^3 =^3\^2- 

e/3 e/3 e/3 
The sets , , and L3 are mutually disjoint. We set 

g,{x)=g2{x)+flf\x\ 



(2.2.21) 



and again note that in (12.2.211) . either g2{x) or f2i^^ {x) equals zero. Similarly to 
what we did above, we conclude that (|2.2.20l) is true for ^3 also. So, gj,{x) is fixed, 

e/3 

uniformly continuous, and g^{x) = for x ^K-^' . 

Continuing the recurrence procedure in the same fashion, we come to the fol- 
lowing objects. 



(a) The sequence — > 00. 
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(b) The sequence of compacts such that for all m 

l^nJ(4)<^- 



(2.2.22) 



re/3 



(c) The sequence of compact sets c such that the sets are disjoint 

(d) The sequence of functions /„, such that for all m 

fm{x) = for all X G K„i-i, 



h 



and 



co/J/i)<2a)(/i) + - 
If,nd'¥„,„>d-5i0{t 



(2.2.23) 
(2.2.24) 

(2.2.25) 



(e) The non-decreasing sequence {^i (x) <g2ix)<.-.} such that gm (x) = g,n- 1 (x) + 



&^^^(x) 



e/3 

gmix) = for X ^K,rl , and 



g,n-l{x)cm'n„ 



(2.2.26) 



Let 



Clearly, < ^(jc) < 1, and 



^ /,N h 3h 
(ii,Jh)<2(i)ih) + j + —. 



g{x) = lim g,n{x). 



^ /,N h 3h 
G)g{h)<2(Dih)+j + —. 



(2.2.27) 



Since the numbers £ and t are fixed, the function g E We show that, nev- 
ertheless, one can choose e and t such that I„:= f gd^n 0- 

To make exposition simpler, we replace the sequence {n^} by N, write ^„ 
instead of ^„„,, and remove ~ from /'s. All of this cannot cause misunderstanding. 

By virtue of (12.2.251) . 

4 = 1 /„ + /(^ - /«)^'^'« ^ ^ - 5a)(f) + /(^ - Qd'Vn. 
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For Jn •= fig- fn)d^n, wc Write 



\Jn\ < 



[ {g-fn)d^n 
JKn 



+i^.ira< 



( {g-fn)d^n 
J K„ 



+ t. 



Now, 



/ {g-f„)cm'n= [ +[ ,,3 + / ,,3 ■.= Jnl+Jn2+Jn3. 

Jk„ Jl„ JK„r\Kl'_. J K„\(L„UKf/J,) 



\{LnUKf,) 

By construction, 7i„ = 0. For the second integral, we have 



\Jn2\ 



< 



< 



+ l^^\^n\{dx) 



.e/3 
n-1 



gd'i'n 



+ 



.e/3 

71-1 



fnd^n 



in view of (|2.2.22l) . 



e/3 

By construction, g{x) = gn-i{x) for x G Kj_i- So, 



(2.2.28) 



L Sd^n = / /3 ^-1^^" = / Sn-id%, 



by virtue of (12.2.261) . 

In view of (12.2.231) and (I2.2.24L 



(2.2.29) 



71-1 



<^'l\^«-l 



fnd^ri 



Thus, 



< (2(0(8/3) + ^] 2 = 4a)(£/3) + |. 



|7„2| <4(o(£/3) + ^+2?. 



(2.2.30) 
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e/3 

To evaluate 7„3, first note that ifxG Kn \ {LnUKj_^), then x G K^_i, and hence 



k„\{l„ukIL\ 



< a)/„(£)|^„|(J. 

J K„\{L„\JKl'^,) 

< (^2(o(£) + ^)2 = 4a)(£) + y. (2.2.31) 

£/3 £/3 

Now, let us observe that if x G -^T^ \ {L^ U ) and x^Lyl , then ^(x) = 0. So, 

Jk„\{l„ukI'_\ ) J {K„\L„)na' 

On the other hand, {Kn\Ln)nLl^^ ^K-v and g{x) < fn{x) on {Kn\Ln) HLf/l 
Thus, for the function g, we have the bound similar to (12.2.311) . and 

|43| <8(0(£) + y. 

Combining the bounds above, we have 

14£ £ 
\Jn\ < 4co(£/3) + 8a)(£) + — + 3t< 12(o{e) + 5- + 3f, 



and 



|/„| > 5 - 5(o{t) - 12(o(£) - 5y - 3? > 6 - ll(o{t) - 5y - 3?, 



because we choose e<t. Without loss of generality we can take t < I. Let £ = r 
Then 

141 >5-17(o(0-8l 
Clearly, one can choose t for which > f for all n. ■ 
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